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(54) Storage apparatus system and method of data backup 



(57) In a storage apparatus system, after having ob- 
tained the coherency between a file system of a main 
storage apparatus system (1180) and the stored data, 
a host computer (1010) issues a freezing instruction to 
a main DKC (1030) which transfers in turn the disk im- 
age at a time point of the issue of freezing instruction to 
a sub-DKC (1 040) and then transmits a signal, showing 
that all the data has been transmitted, to the sub-DKC 



(1 040). In the sub-DKC (1 040), the disk image at a time 
point of reception of the freezing instruction is held until 
a signal showing that all the data has been transmitted 
is issued next time, and when the main storage appara- 
tus system (1180) becomes unusable at an arbitrary 
time point, the data of the disk image, at a time point of 
issue of the freezing instruction, which is held by the 
sub-storage apparatus system (1190) can be utilized. 
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Description 

BACKGROUND OF THE INVENTION 

[0001] The present invention relates in general to a 
storage apparatus system for carrying out the copy (the 
remote copy) of data to another storage apparatus sys- 
tem which is located in an out-of-the-way place. More 
particularly, the invention relates to an information 
processing system for carrying out the remote copy 
which is of the type in which the order of writing data 
from a host computer to a storage apparatus system 
does not match the order of transmitting data from a 
storage apparatus system having the data written there- 
to to another storage apparatus system. 
[0002] In an information processing system having a 
host computer and a plurality of storage apparatus sys- 
tems, as the technology of carrying out the copy of data 
between the storage apparatus systems, there is known 
the remote copy. 

[0003] By the remote copy is meant the technology in 
which a plurality of storage apparatus systems which 
are located physically apart from one another carry out 
the copy of the data, i.e., the double writing of the data 
between the storage apparatus systems without inter- 
position of the host computer. 

[0004] The storage apparatus system is a system in- 
cluding a plurality of storage apparatuses and a control- 
ler for controlling these storage apparatuses. 
[0005] In the information processing system which 
carries out the remote copy, the storage apparatus sys- 
tems which are respectively arranged in the places 
physically remote from one another are electrically con- 
nected to one another through dedicated lines or public 
lines. Of logical storage areas (hereinafter, referred to 
as "logical volumes", when applicable) which a certain 
storage apparatus system has, the logical volume hav- 
ing the same capacity as that of the logical volume sub- 
jected to the remote copy (hereinafter, referred to as "the 
source volume" for short, when applicable) is ensured 
in the storage apparatus system to which the logical vol- 
ume as the source of the copy is copied. This ensured 
logical volume (hereinafter, referred to as "the destina- 
tion volume", when applicable) is formed in such a way 
as to show one-to-one correspondence relation with the 
logical volume as the source of the copy. 
[0006] The data of the logical volume as the source 
of the copy is copied to the logical volume as the desti- 
nation of the copy through the associated one of the 
dedicated lines or public lines. 

[0007] When the data contained in the logical volume 
as the source of the copy is updated, the updated data 
is transferred to the storage apparatus system having 
the logical volume as the destination of the copy through 
the associated one of the dedicated lines or the like and 
the updated data is also written to the logical volume as 
the destination of the copy corresponding to the logical 
volume as the source of the copy. 
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[0008] If the technique of the remote copy is em- 
ployed, then in the information processing system hav- 
ing a plurality of storage apparatus systems, the logical 
volume of the same contents can be held in a plurality 

5 of storage apparatus systems. 

[0009] The technique relating to the remote copy is 
disclosed in U.S. Patent No. 5,742,792. In U.S. Patent 
No. 5,742,792, the technique called the adaptive copy 
is further disclosed. 

10 [0010] By the adaptive copy is meant one of the re- 
mote copy techniques. The adaptive copy is the remote 
copy method wherein before the data written from the 
host computer to the local storage device is copied to 
the remote storage device, the information exhibiting the 

'5 completion of write is returned back to the host compu- 
ter. 

[001 1 ] In the adaptive copy, the transmission order of 
data is not serialized, and hence the order of writing the 
data to the logical volume as the source of the copy by 

20 the host computer may be different from the order of 
transferring these data to the logical volume as the des- 
tination of the copy in some cases (hereinafter, such re- 
mote copy is referred to as the remote copy of "no guar- 
antee to order", when applicable). 

25 [001 2] When the host computer writes repeatedly da- 
ta to the same location in the destination volume on the 
basis of that property, only the data which has been writ- 
ten thereto lastly can be transmitted to the storage ap- 
paratus system having the logical volume as the desti- 

30 nation of the copy. Therefore, the load on the network 
such as the dedicated line between the storage appa- 
ratus systems can be reduced. 

[0013] On the other hand, when the host computer in 
which the file system used in the so-called open system 

35 is incorporated writes the data to the storage apparatus 
system, in general, the buffer and the like provided in 
the host computer, whereby an instruction to transfer the 
data from an application program to the file system is 
made asynchronously with the operation of writing the 

40 data to the storage apparatus system. 

[0014] But, in the case that the data in the file is de- 
stroyed due to various problems, in order to keep the 
coherency of the file system structure, with respect to at 
least the directory and the meta-data such as i-node 

45 which are used to manage the file system, the operation 
of issuing an instruction to transfer the data, i.e., the di- 
rectory and the meta-data from the host computer to the 
storage apparatus system is carried out synchronously 
with issuing of the write command from the application 

50 program running on the host computer to the file system. 
The above-mentioned technique is disclosed in an arti- 
cle of "The Design and Implementation of a Log-Struc- 
tured File System", Mendel Resenblum and John K. 
Ousterhout, ACM Transactions on Computer Systems, 

55 Vol. 10, No. 1, February 1992, page 29. 

[0015] By executing such a processing, even if the da- 
ta in the file which is buffered in the host computer is 
lost due to the asynchronous writing by an abrupt power 
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source shutdown or the like, the m eta-data is not lost at 
all. So, the coherency of the file system structure is kept 
and the damage can be kept to a minimum even though 
the data itself is lost. 

SUMMARY OF THE INVENTION 

[0016] The remote copy of no guarantee to order is 
carried out, whereby the load which is applied to the net- 
work of the dedicated line or the like distributed between 
the storage apparatus systems can be reduced. 
[0017] However, in the remote copy of the order no 
guarantee based on the prior art, it is not taken into con- 
sideration up to the coherency of the meta-data in the 
destination volume to keep the coherency of the file sys- 
tem structure, and hence there is the danger that a large 
amount of files would be lost. 

[0018] More specifically, in the case where the data 
which has been written to the logical volume as the 
source of the copy by the file system is not transferred 
to the logical volume as the destination of the copy syn- 
chronously with the operation of writing the data to the 
file system, with respect to the directory structure of the 
storage apparatus system having the logical volume as 
the destination of the copy, the file system of the host 
computer may not become the state which is intended 
in some cases. 

[0019] Under above circumstance, the data of the 
storage apparatus system having the logical volume as 
the source of the copy is destroyed, even if the file sys- 
tem recovery program such as fsck runs for the storage 
apparatus system having the logical volume as the des- 
tination of the copy, it does not function effectively, and 
as a result the possibility that many files are lost is high. 
Because, the fsck with on the basis of the assumption 
that there is no contradiction between the directory 
structure of the storage apparatus system having the 
source volume and the directory structure of the storage 
apparatus system having the destination volume. 
[0020] In the light of the foregoing, the present inven- 
tion has been made in order to solve the above-men- 
tioned problems associated with the prior art, and it is 
therefore an object of the present invention to provide 
means for even when carrying out the remote copy of 
the no guarantee to order, keeping the coherency of the 
file system structure in the destination volume, so that 
even when the data in the source volume is destroyed, 
the data in the source volume is recovered from the des- 
tination volume by maintaining the coherency of the 
source volume. 

[0021] In order to attain the above-mentioned object, 
according to the present invention, there is provided a 
storage apparatus system having a host computer, a 
main storage apparatus system and a substorage ap- 
paratus system which is electrically connected to the 
main storage apparatus system, wherein an instruction 
is transmitted from the host computer to the main stor- 
age apparatus system in such away as to maintain the 
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data of the main storage apparatus system at a time 
point when the instruction is issued and the fixed data 
is copied to the substorage apparatus system. 
[0022] In addition, the storage apparatus system may 
also be configured in such a way that the data which is 
maintained in the main storage apparatus system is 
transferred to the substorage system, and after comple- 
tion of the transfer of the maintained data, a signal ex- 
hibiting the completion of the transfer of the data is trans- 
ferred from the main storage apparatus system to the 
sub-storage apparatus system, so that with the recep- 
tion of the signal exhibiting the completion of the data 
transfer as a turning point, the data is structured in the 
substorage apparatus system. 

[0023] In addition, the step of maintaining the state of 
the data is to store the data in a first storage area of the 
main storage apparatus system until the instruction is 
issued from the host computer to copy, after the instruc- 
tion has been issued from the host computer, the data 
which was stored in the first storage area at a time point 
of the issue of the instruction to a second storage area 
of the main storage apparatus, and in the step of trans- 
ferring the data, the data which has been copied to the 
second storage area can also be transferred to the sub- 
storage apparatus system. 

[0024] In addition, in the step of structuring the data, 
the maintained data which has been transferred is 
stored in a third storage area of the substorage appara- 
tus system so that using the data which is held in the 
third storage area, the maintained data can also be 
structured in a fourth storage area of the substorage ap- 
paratus system . 

[0025] Also, according to the present invention, there 
is provided a storage apparatus system including: a 
main storage apparatus system which has a first storage 
area, a second storage area and a main disk controller 
and which is electrically connected to a host computer; 
and a substorage apparatus system which has a third 
storage area, a fourth storage area and a sub-disk con- 
troller and which is electrically connected to the main 
storage apparatus system, wherein the main disk con- 
troller includes: means for recording data which has 
been sent from the host computer in the first storage 
area until an instruction is issued from the host compu- 
ter; means for in response to the instruction issued from 
the host computer, copying the data which is recorded 
in the first storage area to the second storage area; and 
means for sending the copied data to the substorage 
apparatus system. Then, the sub-disk controller in- 
cludes: means for receiving the data sent thereto to hold 
the received data in the third storage area; and means 
for structuring the data, which is held in the first storage 
area at a time point when the instruction has been is- 
sued from the host computer, in the fourth storage area 
using the data which is held in the third storage area. 
[0026] According to another aspect of the present in- 
vention, the host computer issues a freezing instruction 
to the storage apparatus system as the destination of 
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the data transfer, and the storage apparatus system as 
the source of the data transfer transfers the data, which 
is held in the storage apparatus system at a time point 
of the issue of the freezing instruction, and the arrange- 
ment thereof (hereinafter, referred to as "the volume im- 
age" for short, when applicable) to the storage appara- 
tus system as the destination of the data transfer. All 
data transfer completion is reported which means that 
the volume image at a time point when the freezing in- 
struction has been issued has already been transferred 
to the storage apparatus system as the destination of 
the data transfer. 

[0027] In the storage apparatus system as the desti- 
nation of the data transfer, the data of the volume image, 
at a time point of the issue of the freezing instruction, in 
the source of the data transfer is held, and when the 
report exhibiting the completion of the data transfer will 
be made next time, the volume image will be updated 
using the transferred data. 

[0028] As a result, when the disk unit system in the 
source of the data transfer at an arbitrary time point has 
become unusable, it is possible to utilize the volume im- 
age which is held in the storage apparatus system as 
the destination of the data transfer. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0029] The above and other objects as well as advan- 
tages of the present invention will become clear by the 
following description of the preferred embodiments of 
the present invention with reference to the accompany- 
ing drawings, wherein: 

Fig. 1 is a block diagram showing a configuration of 

a computer system to which a first embodiment of 

the present invention is applied; 

Figs. 2A to 2C are respectively schematic views 

useful in explaining the flow of the data in the first 

embodiment; 

Fig. 3 is a block diagram showing an internal con- 
figuration of a DKC; 

Fig. 4 is a flow chart useful in explaining the write 
processing in the first embodiment; 
Fig. 5 is a flow chart useful in explaining the main 
remote copy processing in the first embodiment; 
Fig. 6 is a flow chart useful in explaining the sub- 
remote copy processing in the first embodiment; 
Fig. 7 is a flow chart useful in explaining the main 
freezing processing in the first embodiment; 
Fig. 8 is a flow chart useful in explaining the sub- 
freezing processing in the first embodiment; 
Fig. 9 is a flow chart useful in explaining the sub- 
recovery processing in the first embodiment; 
Fig. 1 0 is a flow chart useful in explaining the read- 
ing processing in the first embodiment; 
Fig. 11 is a schematic view useful in explaining the 
flow of the freezing instruction corresponding to the 
first embodiment; 
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Fig. 12 is a block diagram showing a configuration 
of a computer system to which a second embodi- 
ment of the present invention is applied; 
Figs. 13A to 13D are respectively schematic views 
useful in explaining the flow of the data in the sec- 
ond embodiment; 

Fig. 14 is a schematic view useful in explaining the 
flow of a freezing instruction in the second embod- 
iment; 

Fig. 15 is a flow chart useful in explaining the write 
processing A in the second embodiment; 
Fig. 1 6 is a flow chart useful in explaining the main 
freezing processing A in the second embodiment; 
Fig. 17 is a flow chart useful in explaining the sub- 
remote copy processing A in the second embodi- 
ment; 

Fig. 18 is a flow chart useful in explaining the sub- 
freezing processing A in the second embodiment; 
Fig. 1 9 is a block diagram showing a configuration 
of a computer system to which a third embodiment 
of the present invention is applied; 
Figs. 20A to 20D are respectively schematic views 
useful in explaining the flow of the data in the third 
embodiment; 

Fig. 21 is a schematic view useful in explaining the 
flow of a freezing instruction in the third embodi- 
ment; 

Fig. 22 is a flow chart useful in explaining the main 
write processing B in the third embodiment; 
Fig. 23 is a flow chart useful in explaining the main 
freezing processing B in the third embodiment; 
Fig. 24 is a flow chart useful in explaining the main 
copy processing B in the third embodiment; 
Fig. 25 is a flow chart useful in explaining the main 
remote copy processing B in the third embodiment; 
Fig. 26 is a flow chart useful in explaining the main 
freezing completion processing in the third embod- 
iment; 

Fig. 27 is a flow chart useful in explaining the sub- 
freezing processing in the third embodiment; and 
Fig. 28 is a flow chart useful in explaining the sub- 
remote copy processing B in the third embodiment; 

DESCRIPTION OF THE EMBODIMENTS 

[0030] The preferred embodiments of the present in- 
vention will hereinafter be described in detail with refer- 
ence to the accompanying drawings. 
[0031] Fig. 1 is a block diagram showing a configura- 
tion of a first embodiment of a computer system 1 000 to 
which the present invention is applied. 
[0032] The computer system 1000 includes a host 
computer 1 01 0, a main storage apparatus system 1 1 80, 
a substorage apparatus system 1 1 90 for carrying out the 
remote copy between the main storage apparatus sys- 
tem 1 1 80 and the sub-storage apparatus system 1 1 90, 
a sub-host computer 1 020 and a network 1 050 through 
which the main storage apparatus system 1 1 80 and the 
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sub-storage apparatus system 1 1 90 are linked to each 
other. 

[0033] The substorage apparatus system 1190 is 
used when the main storage apparatus system 1 1 80 be- 
comes unusable due to the calamity or the like. The sub- 
host computer 1020, when the host computer 1010 or 
the main storage apparatus system 1180 becomes un- 
usable, takes over the processing which the host com- 
puter 1010 is expected essentially to execute, using the 
data in the sub-storage apparatus system 1190. 
[0034] For the network 1 050, it is assumed that it is 
the shared network such as the Internet, and the transfer 
rate of the data is not so high. In the present embodi- 
ment, it is assumed that the remote copy between the 
main storage apparatus system 1 1 80 and the substor- 
age apparatus system 1190 is carried out with the no 
guarantee to order while no heavy load is applied to the 
network 1 050. By the way, the data transfer rate of the 
network 1 050 may be high as well. 
[0035] The main storage apparatus system 1180 in- 
cludes a main disk unit 1130 in which the data trans- 
ferred from the host computer 1 01 0 is stored, and a main 
disk controller 1030 (hereinafter, referred to as "a DKC" 
for short, when applicable) for controlling the main disk 
unit 1130. 

[0036] I n the present embodiment, the host computer 
1010 issues an instruction to the main storage appara- 
tus system 1 1 80 in such a way as to carry out "the freez- 
ing" (hereinafter, referred to as "the freezing instruction" 
when applicable). 

[0037] The meaning of "the freezing" is to hold, for the 
substorage apparatus system 1 1 90, the same volume 
image as that of the main storage apparatus system 
1 1 80 at a time point when the host computer 1 01 0 has 
issued the instruction. 

[0038] The main disk unit 1130 includes a main vol- 
ume 1120 and a main differential volume 1140. Each of 
the main volume and the main differential volume may 
be either the logical volume or the physical volume. In 
the case of the logical volume, as in the present embod- 
iment, a plurality of volumes may be present in the main 
disk unit in some cases. On the other hand, in the case 
of the physical volume, the main disk unit further in- 
cludes a plurality of disk units each of which constitutes 
the physical volume. In addition, in the case as well of 
the logical volume, the main disk unit may be constituted 
by a plurality of disk units. 

[0039] In the main volume 1120, there is stored the 
data which has been transferred from the host computer 
1010 to the main storage apparatus system 1180. 
[0040] In the main differential volume 1 1 40, for a time 
period ranging from a time point when the main storage 
apparatus system 1180 has received the freezing in- 
struction from the host computer 1 01 0 up to a time point 
when the processing of the freezing has been complet- 
ed (hereinafter, such a time period is referred to as "in 
the freezing" for short, when applicable), there is stored 
the data which has been transferred from the host com- 
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puter 1010. 

[0041 ] The main DKC 1 030 has a main freezing mode 
1 060, a main bitmap 1 070 and a main differential bitmap 
1080 on the memory. 

5 [0042] The main freezing mode 1 060 shows whether 
or not the main DKC 1 030 itself is executing the process 
of the freezing. For example, if it is judged that the main 
DKC 1 030 itself is executing the processing in the freez- 
ing, then the mode becomes 1 . 

10 [0043] The main bitmap 1070 and the main differential 
bitmap 1 080 have the respective bits each correspond- 
ing to a block which the main volume 1120 has. 
[0044] The main bitmap 1 070 shows the blocks in the 
main volume 1 1 20. These blocks are the data, which are 

15 not yet transferred to the sub-DKC 1 040, among the da- 
ta stored in the main volume 1 1 20 before the main stor- 
age apparatus system 1180 receives the freezing in- 
struction from the host computer 101 0. 
[0045] The main differential bitmap 1080 shows the 

20 blocks which contain the data which the main disk unit 
1130 has received from the host computer 1010 while 
the main DKC 1030 is executing the process of the 
freezing. 

[0046] The data is stored in the log-structured post- 
25 script type file format in the main difference volume 
1140. The block numbers exhibiting corresponding 
blocks in the main volume 1120 are also contained in 
the stored data. 

[0047] In the case where the write data to be written 
30 to the main volume 1 1 20 is received while the main DKC 
1 030 is executing the process of the freezing, the main 
DKC 1030 checks the main differential bitmap 1080. 
When the write data to be written has already been 
present in the main differential volume 1140, the data 
35 which was written to the main differential volume 1140 
prior thereto is cancelled in such a way that a plurality 
of data written to the same block are not present in the 
main differential volume 1140. 

[0048] The substorage apparatus system 1190 in- 
40 eludes a sub-disk unit 1 1 60 in which the data which has 
been remote-copied from the main storage apparatus 
system 1 1 80 is stored, and a sub-DKC 1 040 for control- 
ling the sub-disk unit 1160. 

[0049] The sub-disk unit 1 1 60 includes a sub-volume 
45 1 1 50, a sub-differential volume A 1 1 70 and a sub-differ- 
ential volume B 1175. 

[0050] In the sub-volume 1150, there is stored the vol- 
ume image of the main volume 1120 at a certain time 
point, more specifically, at a time point when the host 

50 computer 1010 previously issued the freezing instruc- 
tion to the main storage apparatus system 11 80. 
[0051] In the sub-differential volume A 1170, there is 
stored the data which was written to the main storage 
apparatus system 1180 on and after the host computer 

55 1010 previously issued the freezing instruction to the 
main storage apparatus system 1180. 
[0052] The blocks of the sub-volume 1150 and the 
main volume 1120 show one-to-one correspondence. 



EP 1 255 198 At 



5 



EP 1 255 198 



r Page 6 of 49 



9 



EP 1 255 198 A1 



10 



[0053] The sub-DKC 1040 includes a sub-freezing 
mode 1090, a sub-bitmap 1100 and a sub-differential 
bitmap 1 1 1 0 on a memory (not shown). 
[0054] The value of the sub-freezing mode 1 090 be- 
comes zero when the sub-DKC 1040 does not execute 
the process of the freezing, and becomes 1 or 2 when 
the sub-DKC 1 040 is executing the process of the freez- 
ing. 

[0055] The sub-bitmap 11 00 and the sub-differential 
bitmap 1110 are constituted with the same number of 
bits as the number of blocks which the sub-volume A 
1150 has, and 1 bit corresponds to 1 block. 
[0056] The sub-bitmap 1100 shows the presence or 
absence of the data which is stored in the subdifferential 
volume A 1170. 

[0057] The sub-differential bitmap 1110 shows the 
presence or absence of the data which is stored in the 
sub-differential volume B 1175. 

[0058] The data is respectively stored in the log-struc- 
tured type file format in the sub-differential volume A 
1 1 70 and the sub-differential volume B 1 1 75 similarly to 
the main differential volume 1140. The block numbers 
exhibiting the corresponding blocks in the sub-volume 
1 150 are also contained in the data which is respectively 
stored therein. 

[0059] The sub-DKC 1040 executes the same 
processing as that in the main DKC 1030 to cancel the 
old data in such a way that two or more data correspond- 
ing to the same block is not present in the sub-differen- 
tial volume A 1170 and the sub-differential volume B 
1175. 

[0060] While in the present embodiment, the host 
computer 1010 issues the freezing instruction, alterna- 
tively, the main DKC 1030 or the sub DKC 1040 may 
issue the freezing instruction. 

[0061] The application program which runs on the 
host computer 1010 issues an instruction to write data 
to the main storage apparatus system 1 1 80. But, in ac- 
tuality, there may be the case where the data is written 
to the cache or buffer memory of the host computer 1010 
and hence the contents of the data stored in the main 
storage apparatus system 1 1 80 become the state which 
the application program does not intend (i.e., the data 
which ought to have been written is not yet written in 
actual). 

[0062] If under this state, the host computer 1010 has 
gone down due to a shutdown of the power source, and 
the file system recovery program such as fsck is exe- 
cuted for the main storage apparatus system 1 1 80, then 
there is the possibility that the data which is not reflected 
in the main storage apparatus system 1 1 80 may be lost. 
[0063] In order to prevent the data which is not reflect- 
ed in the main storage apparatus system 1 1 80 from be- 
ing lost, the main DKC 1 030 or the like should not issue 
freely the instruction for the freezing, but the instruction 
for the freezing should be issued after the host computer 
1 01 0 has written all of the unreflected data on the cache 
or buffer memory to the main storage apparatus system 
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[0064] Figs. 2A to 2C show the flow of the data in the 
present embodiment. 

[0065] Fig, 2A is a schematic view showing the flow 
5 of the data in the state in which the host computer 1010 
has not yet issued the freezing instruction, i.e., in the 
normal state. 

[0066] The data which has been sent from the host 
computer 1010 is written to the main volume 1120 (in- 
fo dicated by an arrow A 1 00). The data which has been 
newly written to the main volume 1120 is read out from 
the main volume 1 1 20 to the main DKC 1 030 to be trans- 
ferred to the sub-DKC 1 040 to be written to the sub-dif- 
ferential volume 11 70 (indicated by an arrow B 110). 
'5 [0067] At an arbitrary time point in Fig. 2A, in the sub- 
volume 1 1 50, there is stored the same volume image as 
that of the main volume 1120 at a time point when the 
host computer 1 01 0 issued the freezing instruction last 
time. 

20 [0068] Fig. 2B is a schematic view showing the flow 
of the data from a time point after the host computer 
1010 issues the freezing instruction up to a time point 
when the main DKC 1030 issues a notification com- 
mand reporting that all of the data has been sent (here- 
25 inafter, referred to as "all freezing data transmission 
completion", when applicable) to the sub-DKC 1 040. 
[0069] If the data sent from the host computer 1010 
is the data which is to be stored in the block of the main 
disk unit 1130 in which data at a time point when the 
30 host computer 1010 issued the freezing instruction has 
already been sent to the sub-DKC 1040, it is written to 
the main volume 1120 as it is (indicated by an arrow C 
120). On the other hand, if the data which has been sent 
from the host computer 1 01 0 is the data to be stored in 
35 the block which is still holding the data not yet sent to 
the sub-DKC 1 040, it is written to the main differential 
volume 1140 (indicated by an arrow D 130). 
[0070] The block containing the data which is stored 
in the main volume 1 120 and which is not yet sent to the 
40 sub-DKC 1040 at a time point when the freezing instruc- 
tion issued from the host computer 1 01 0 is read out from 
the main volume 1 1 20 to the main DKC 1 030 to be trans- 
ferred to the sub-DKC 1040 to be written to the sub-dif- 
ferential volume A 11 70 (indicated by an arrow E 140). 
45 [0071] The main DKC 1030, in accordance with the 
contents of the main bitmap 1070, transfers all of the 
difference data between the main volume 1120 and the 
sub-volume 1150 at a time point when the freezing in- 
struction issued from the host computer 1 01 0 to the sub- 
50 differential volume A 11 70. After completion of all of the 
transfers, the main DKC 1030 informs the sub-DKC 
1 040 that all of the freezing data has been transferred. 
[0072] At an arbitrary time point in Fig. 2B, in the sub- 
volume 1150, there is stored the volume image having 
& the same contents as those of the volume image which 
the main volume 1 1 20 held at a time point when the host 
computer 1010 issued the instruction for the freezing 
last time. 
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[0073] Fig. 2C is a schematic view showing the flow 
of the data ranging from a time point when the main DKC 
1 030 informed the sub-DKC 1 040 of that all of the freez- 
ing data has been transferred up to a time point when 
the main DKC 1030, using the data stored in the main 5 
differential volume 1140, updates the data stored in the 
main volume 1120, and also the sub-DKC 1040, using 
the data stored in the sub-differential volume A 1170, 
updates the data which is stored in the sub-volume 
1150. 

[0074] The data which has been transferred from the 
host computer 1 01 0 is written to the main volume 11 20 
(indicated by an arrow F 150). 

[0075] The data which is stored in the main volume 
1120 is updated oh the basis of the data which is stored 
in the main differential volume 1140 (indicated by an ar- 
row G 1 60). But, in the case where the block containing 
the data becoming an object of the update is already 
updated the data which has been transferred from the 
host computer 1 01 0, the update of the data in the main 
volume 1120 corresponding to the data stored in the 
main differential volume 1140 is not carried out. 
[0076] The data which has been transferred from the 
host computer 1 01 0 to the main disk unit 1 1 30 after the 
freezing instruction from the host computer 1010 is read 
out from the main volume 1120 to the main DKC 1030 
to be sent to the sub-DKC 1 040 to be stored in the sub- 
differential volume B 1 1 75 (indicated by an arrow H 1 70). 
[0077] The sub-DKC 1040 reads out the data in the 
sub-differential volume A 1 1 70 to the sub-DKC 1 040 to 
store that data in the sub-volume 1150 (indicated by an 
arrow I 180). 

[0078] At an arbitrary time point in Fig. 2C, the data 
stored in the sub-volume 1 1 50 is combined with the data 
stored in the sub-differential volume A 1170, whereby 
the volume image of the main volume 1120 at a time 
point when the host computer 1010 issued the freezing 
instruction to the main DKC 1030 that time is repro- 
duced. 

[0079] From the foregoing, in Figs. 2A and 2B, the da- 
ta of the volume image having the same contents as 
those of the data of the volume image of the main disk 
unit 1120 at a time point when the freezing instruction 
was issued by the host computer 1010 last time is 
present in the sub-volume 1150. In Fig. 2C, the data of 
the volume image having the same contents as those 
of the data of the volume image in the main disk unit 
1120 at a time point when the freezing instruction was 
issued at that time can be reproduced by combining the 
data stored in the sub-volume 1150 with the data in the 
sub-differential volume A 1170. 

[0080] In other words, in any case, the volume images 
which are coherent with the volume images of the main 
disk unit 1120 at a time point when the host computer 
1010 issued the freezing instruction is prepared in the 
sub-disk unit 1160. 

[0081] Fig. 3 is a block diagram of the main DKC 1 030. 
[0082] The main DKC 1030 includes a host interface 
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1210, a drive interface 1230, a network interface 1220, 
a CPU 1240, a ROM 1250, a RAM 1260, and a direct 
memory access controller 1270. 

[0083] The program which runs on the CPU 1240 is 
stored in the ROM 1250. 

[0084] The main freezing mode 1060, the main bit- 
map 1 070, and the main differential bitmap 1 080 are 
stored in the RAM 1260. The RAM is also used as the 
cache memory. 

[0085] The CPU 1240 controls the main storage ap- 
paratus 1180. In the CPU 1240, a multitask operating 
system is running, so a write processing 2000, a main 
freezing processing 2600 and the like can be processed 
in parallel with one another. 

[0086] The sub-DKC 1 040 has also the same config- 
uration as that of the main DKC 1030. But, in the 
sub-DKC 1040, the host interface 1210 is electrically 
connected to the sub-host computer 1 020, and the drive 
interface 1230 is electrically connected to the sub-disk 
1160. In the RAM 1260, the sub-freezing mode 1090, 
the sub-bitmap 1100 and the sub-differential bitmap 
1110 are stored. 

[0087] Fig. 4 is a flow chart of the write processing 
2000 which is executed in the main DKC 1 030 when the 
host computer 1 010 sends the write command to write 
data and the data to be written (hereinafter, referred to 
as "the write data" for short, when applicable) to the 
main storage apparatus system 1180. 
[0088] The main DKC 1 030 receives the write data 
through the host interface 1210 (Step 2010) to judge 
whether or not the main freezing mode 1060 stored in 
the RAM 1260 is in the ON state (Step 2020). 
[0089] If it is judged in Step 2020 that the main freez- 
ing mode 1 060 is in the OFF state, then the main DKC 
1030 sets to 1 the bit of the main bitmap 1070 corre- 
sponding to the block having the main volume 1120 to 
which the write data received by the main DKC 1 030 is 
written (Step 2030). 

[0090] The main DKC 1 030 controls the main disk unit 
1 1 30 in such a way that the write data is written to the 
main volume 1120 (Step 2040). The main DKC 1030 it- 
self judges whether or not a main remote copy process- 
ing 2200 is being executed (Step 2050). If it is judged in 
Step 2050 that the main remote copy processing 2200 
is not being executed, then the remote processing is 
completed after the main DKC 1030 has executed the 
main remote copy processing 2200. On the other hand, 
if it is judged in Step 2050 that the main remote copy 
processing 2200 is being executed, then the write 
processing 2000 is completed. 

[0091 ] If it is judged in Step 2020 that the main freez- 
ing mode 1060 is in the ON state, then the main DKC 
1030 judges whether or not the bit of the main bitmap 
1070 corresponding to the block to which the received 
write data is to be written is 1 (Step 2060). If it is judged 
in Step 2060 that the corresponding bit is zero, then the 
processing in Step 2030 is executed. On the other hand, 
if it is judged in Step 2060 that the corresponding bit is 
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1, then the bit of the main differential bitmap 1080 cor- 
responding to the block in the main volume 1120 in 
which the received write data is to be stored is set to 1 
(Step 2070). 

[0092] The main DKC 1 030 controls the main disk unit 
1130 in such a way that the block number information in 
the main volume 1120 is added to the received write da- 
ta, and then the write data is written to the main differ- 
ential volume 1140 (Step 2080). Thereafter, the 
processing in Step 2050 is executed. 
[0093] Fig. 5 is a flow chart in explaining a main re- 
mote copy processing 2200 which the main DKC 1030 
executes. 

[0094] The main remote copy processing 2200 is the 
processing which is called from the above-mentioned 
write processing 2000 and from the main freezing 
processing 2600 which will be described later. 
[0095] The main DKC 1 030 judges whether or not the 
corresponding bit of the main bitmap 1070 is 1 and also 
whether or not the block which contains the data stored 
in the RAM 1260 is present in the main volume 1120 
(Step 2230). If it is judged in Step 2230 that the block 
corresponding to the condition is present therein, then 
the main DKC 1 030 specifies the block of interest to ex- 
ecute the processing in Step 2260. 
[0096] On the other hand, if it is judged in Step 2230 
that the block corresponding to the condition is absent, 
then the main DKC 1030 judges whether or not the bit 
of 1 is present in the main bitmap 1070 (Step 2240) If 
it is judged in Step 2240 that the bit of 1 is not present 
in the main bitmap 1070, then the main remote copy 
processing 2200 is completed. 

[0097] On the other hand, if it is judged in Step 2240 
that the bit of 1 is present in the main bitmap 1 070, then 
the main DKC 1030 specifies the block corresponding 
to the bit of 1 in the main bitmap 1070 to read out the 
data in the block thus specified from the main volume 
1120 to store the data thus read out in the RAM 1260 
(Step 2250). 

[0098] The main DKC 1 030 makes zero the bit of the 
main bitmap 1070 corresponding to the specified block 
(Step 2260). The main DKC 1030 transfers the data, 
which has been read out, to the sub-DKC 1 040 through 
the network interface 1220 (Step 2270). 
[0099] After having received the report, from the 
sub-DKC 1 040, that the sub-DKC 1 040 received the da- 
ta of interest (Step 2280), the main DKC 1030 returns 
back to the processing in Step 2230. 
[0100] Fig. 6 is a flow chart useful in explaining a sub- 
remote copy processing 2400 which the sub-DKC 1 040 
executes at the time when the main DKC 1 030 has sent 
the data to the sub-DKC 1040. 

[0101] The sub-DKC 1040 receives the data which 
has been sent from the main DKC 1 030 through the net- 
work interface 1220 (Step 2410), and then transmits the 
report exhibiting the reception of the data to the main 
DKC 1030 (Step 2420). 

[0102] The sub-DKC 1040 judges whether or not the 



value of the sub-freezing mode 1090 stored in the RAM 
1260 is 2 (Step 2430), and if it is judged in Step 2430 
that the value of interest is not 2, controls the sub-disk 
unit 1 1 60 in such a way that the received data is written 
5 to the sub-differential value A 1 1 70 (Step 2440). 

[0103] The sub-DKC 1040 makes 1 the bit of the sub- 
bitmap 1 1 00 corresponding to the block having the writ- 
ten data to complete the sub-remote processing 2400 
(Step 2450). 

10 [01 04] On the other hand, if it is judged in Step 2430 
that the value of the sub-freezing mode 1 090 is 2, then 
the sub-DKC 1040 controls the sub-disk unit 1160 in 
such a way that the received data is written to the sub- 
differential value B 1175 (Step 2460). 
is [0105] The sub-DKC 1 040 sets to 1 the bit of the sub- 
differential bitmap 1110 corresponding to the block hav- 
ing the written data to complete the sub-remote copy 
processing 2400 (Step 2470). 

[0106] Fig. 7 is a flow chart useful in explaining a main 
2 o freezing processing 2600 which the main DKC 1 030 ex- 
ecutes at the time when the host computer has issued 
the freezing instruction. 

[0107] After having received the freezing instruction 
from the host computer 1010 through the host interface 
25 1210, the main DKC 1030 turns ON the main freezing 
mode 1060 which is stored in the RAM 1260 (Step 
2610). 

[0108] The main DKC 1030 transmits the freezing in- 
struction to the sub-DKC 1040 (Step 2620). The main 
30 DKC 1030 judges whether or not the main DKC 1030 
itself is executing the remote copy processing 2200 
(Step 2625). 

[0109] If it is judged in Step 2625 that the main DKC 
1030 itself is executing the remote copy processing 
35 2200, then the main DKC 1 030, after having carried out 
the step of waiting for some time (e.g., several millisec- 
onds) (Step 2635), executes the processing in Step 
2640. 

[0110] On the other hand, if it is judged in Step 2625 
40 that the main DKC 1030 itself is not executing the re- 
mote copy processing 2200, then the main remote copy 
processing 2200 is executed (Step 2630) to execute the 
processing in Step 2640. 

[0111] In Step 2640, the main DKC 1030 judges 
45 whether or not all of the bits of the main bitmap 1070 
are zero. If the bit exhibiting 1 is present in the main 
bitmap 1 070, then since the data to be sent to the 
sub-DKC 1040 still remains in the main disk unit 1130, 
the main DKC 1 030 executes again the processings af- 
50 ter Step 2625 until all of the bits of the main bitmap 1 070 
have become zero. 

[0112] On the other hand, if it is judged in Step 2640 
that all of the bits of the main bitmap 1 070 are zero, then 
the main DKC 1030 transmits the information, that the 
55 freezing data has already been transmitted, to the 
sub-DKC 1040 (Step 2650). 

[0113] The main DKC 1030 judges whether or not all 
of the values of the main differential bitmap 1080 are 
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zero (Step 2660). 

[01 1 4] If it is judged in Step 2660 that all of the values 
of the main differential bitmap 1080 are not zero, then 
the main DKC 1030 controls the main disk unit 1130 in 
such a way that the data of the block, in which the bit in 
the main differential bitmap 1080 is 1 , is read out from 
the main differential volume 1 1 40 (Step 2670) to be writ- 
ten to the block to which the main volume 1120 corre- 
sponds (Step 2680). 

[0115] The main DKC 1030 sets to zero the bit of the 
main differential bitmap 1 080 corresponding to the block 
containing the written data (Step 2690), while it sets to 
1 the corresponding bit of the main bitmap 1070 to return 
back to the processing in Step 2660 (Step 2695). 
[0116] On the other hand, if it is judged in Step 2660 
that all of the values of the main differential bitmap 1 080 
are zero, then the main DKC 1 030 waits for the comple- 
tion report from the sub-DKC 1040 (Step 2700). After 
having received the completion report transmitted from 
the sub-DKC 1040 (Step 2710), the main DKC 1030 
turns OFF the main freezing mode 1 060 which is stored 
in the RAM 1260 (Step 2720) to transmit a signal exhib- 
iting the freezing processing completion report to the 
host computer 1010 to complete the main freezing 
processing 2600 (Step 2730). 

[0117] Upon completion of the processing in Step 
2650, the processing in Step 2700 may be executed, 
and the update processing for the main differential vol- 
ume (Steps 2660 to 2695) may be executed after com- 
pletion of the main freezing processing. 
[0118] Fig. 8 is a flow chart useful in explaining a sub- 
freezing processing 2800 which the sub-DKC 1 040 ex- 
ecutes at the time when the main DKC 1 030 has issued 
the freezing instruction to the sub-DKC 1040. 
[0119] After having received the freezing instruction 
command from the main DKC 1 030, the sub-DKC 1 040 
sets to 1 the sub-freezing mode 1 090 which is stored in 
the RAM 1260 (Step 2810) to wait for the report, exhib- 
iting that all of the freezing data has already been trans- 
mitted, from the main DKC 1030 (Step 2820). 
[0120] After having received the report exhibiting the 
completion of the transmission of all of the freezing data 
from the main DKC 1030, the sub-DKC 1040 sets to 2 
the sub-freezing mode 1090 (Step 2825). 
[0121] The sub-DKC 1040 judges whether or not the 
corresponding bit of the sub-bitmap 1100 stored in the 
RAM 1 260 is 1 and also whether or not the correspond- 
ing block having the data is present on the RAM 1260 
(Step 2830). 

[0122] If it is judged in Step 2830 that the correspond- 
ing block is present on the RAM 1 260, then the sub-DKC 
1 040 executes the processing in Step 2860. On the oth- 
er hand, if it is judged in Step 2830 that the correspond- 
ing block is not present on the RAM 1260, then it is 
judged whether or not the block in which the correspond- 
ing bit of the sub-bitmap 1100 is 1 is present (Step 2840). 
[0123] If it is judged in Step 2840 that the block in 
which the corresponding bit of the sub-bitmap 11 00 is 1 



is present, then the sub-DKC 1040 reads out the data 
corresponding to the bit as 1 from the sub-differential 
volume A 1170 to the RAM 1260 (Step 2850) to write 
the data of interest to the block of the sub-volume 1 1 50 
5 corresponding to the data read to the RAM 1260 (Step 
2860). 

[0124] The sub-DKC 1040 sets to zero the bit of the 
sub-bitmap 1100 corresponding to the data which has 
already been written (Step 2870) to return back to the 

10 processing in Step 2830. 

[0125] On the other hand, if it is judged in Step 2840 
that the block in which the corresponding bit of the sub- 
bitmap 1 1 00 is 1 is absent, then the sub-DKC 1 040 sets 
to zero the sub-freezing mode 1090 (Step 2880) to 

15 transmit the report exhibiting the completion of the sub- 
freezing processing to the main DKC 1 030 (Step 2890) 
to complete the sub-freezing processing 2800. 
[0126] Fig. 9 is a flow chart useful in explaining a sub- 
recovery processing 3000 which the sub-DKC 1040 ex- 

20 ecutes in accordance with the instruction from the sub- 
host computer 1 020 in the case where the host compu- 
ter 1 01 0 and the main storage apparatus 1 1 80 become 
both unusable at all due to a disaster or the like. 
[0127] After having received the instruction issued 

25 from the sub-host computer 1020, the sub-DKC 1040 
judges whether or not the sub-freezing mode 1090 is 1 
(Step 3010). If it is judged in Step 1040 that the sub- 
freezing mode 1090 is 1, then the sub-DKC 1040 sus- 
pends the sub-freezing processing 2800 which the 

30 sub-DKC 1040 itself is executing (Step 3040) to set to 
zero the sub-freezing mode (Step 3050). 
[0128] The sub-DKC 1 040 initiallizes all of the values 
of the sub-differential bitmap to zero (Step 3060) to 
erase the information which the sub-differential volume 

35 A 1170 and the sub-differential volume B 1175 have 
(Step 3070). 

[0129] The sub-DKC 1040 transmits the completion 
report to the sub-host computer 1020 (Step 3080) to 
complete the sub-recovery processing 3000. 

40 [0130] On the other hand, if it is judged in Step 3010 
that the sub-freezing mode 1090 is not 1, then the 
sub-DKC 1040 judges whether or not the sub-freezing 
mode 1090 is zero (Step 3020). If it is judged in Step 
3020 that the sub-freezing mode 1090 is zero, then the 

45 sub-DKC 1040 executes the processing in Step 3060. 
On the other hand, if it is judged in Step 3020 that the 
sub-freezing mode 1090 is not zero, then the sub-DKC 
1040 waits for the sub-freezing mode 1090 to become 
zero to execute the processing in Step 3020 (Step 

50 3030). 

[0131] By executing the sub-recovery processing 
3000, the volume image of the main volume 1120 at a 
time point when the freezing instruction was issued from 
the host computer 1 01 0 to the main DKC 1 030 last time 
55 or this time is copied to the sub-volume 1 1 50. Then , the 
sub-host computer 1 020 can use freely the copied vol- 
ume image. 

[0132] Fig. 10 is a flow chart useful in explaining a 
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read processing 3200 which the main DKC 1030 exe- 
cutes at the time when the host computer 101 0 has is- 
sued the read command to read the data to the main 
storage apparatus system 1180. 
[0133] After having received the read command is- 
sued from the host computer 1010, the main DKC 1 030 
judges whether or not the data which has been request- 
ed from the host computer 1010 is present in the RAM 
1260 (Step 3205). 

[0134] If it is judged in Step 3205 that the requested 
data is not present in the RAM 1 260, then the main DKC 
1030 checks the main freezing mode (Step 3210). If it 
is judged in Step 321 0 that the main freezing mode 1 060 
is OFF, then the main DKC 1 030 reads outthe requested 
data from the main volume 1130 (Step 3220) to transfer 
the data of interest to the host computer 1010 to com- 
plete the read processing 3200 (Step 3230). 
[0135] On the other hand, if it is judged in Step 3210 
that the main freezing mode 1 060 is ON, then the main 
DKC 1 030 judges whether or not the bit of the main dif- 
ferential bitmap 1 080 corresponding to the data request- 
ed from the host computer 1010 is 1 (Step 3240). 
[0136] If it is judged in Step 3240 that the correspond- 
ing bit is zero, then the main DKC 1030 executes the 
processing in Step 3220. On the other hand, if it is 
judged in Step 3240 that the corresponding bit is 1 , then 
the main DKC 1030 finds out the data, which has been 
required from the host computer 1010, from the main 
differential volume 11 40 to read outthe data thus found 
out to execute the processing in Step 3230 (Step 3250). 
[0137] On the other hand, if it is judged in Step 3205 
that the requested data is present in the RAM 1260, then 
the main DKC 1030 executes the processing in ' Step 
3230. 

[0138] Fig. 11 is a schematic view useful in explaining 
the transmission and the reception of the freezing in- 
struction between the apparatuses included in the host 
computer 1 000. 

[0139] In Fig. 11 , the vertical axis represents the time 
base. Thus, it is meant that the time elapses as the po- 
sition on the drawing is located more downwardly. 
[0140] The host computer 1010 issues the freezing in- 
struction to the main DKC 1030, and then in response 
to the freezing instruction issued thereto, the main DKC 
1030 issues the freezing instruction to the sub-DKC 
1040. 

[0141] After having transferred the volume image of 
the main volume 1120 at a time point of the reception of 
the freezing instruction to the sub-DKC 1 040, the main 
DKC 1030 transmits the report showing the completion 
of the transfer of all of the freezing data to the sub-DKC 
1040. 

[0142] The sub-DKC 1040 reflects the data of the 
main volume 1120 at a time point of the issue of the 
freezing instruction to the sub-volume 1150, and after 
completion of the reflection of the data, informs the main 
DKC 1030 of the completion of the freezing. In response 
thereto, the main DKC 1030 informs the host computer 



1010 of the completion of the freezing. 
[0143] By adopting the configuration of the present 
embodiment, the data which is held in the main disk unit 
at a time point when the freezing instruction is issued 
5 from the host computer 1 01 0 can be held in the sub-disk 
unit, and hence even when the data is destroyed, the 
loss of the data can be suppressed to a minimum.' 
[0144] In other words, the sub-storage apparatus sys- 
tem 11 90 holds the data at a time point of the issue of 
10 the freezing instruction and at the same time, holds as 
the differential data the data which was written on and 
after that time point. This freezing is carried out at peri- 
odic intervals, whereby when the data of the main stor- 
age apparatus system 1180 is not able to be used due 
« to for some cause or other, all of the data at a time point 
when it was frozen last time can be obtained from the 
sub-storage apparatus system 1190. 
[0145] In this connection, while in the present embod- 
iment, the description has been given on the assumption 
20 that a plurality of volumes are present inside of the main 
disk unit 1130, the present invention is not intended to 
be limited thereto. That is, a plurality of disk units may 
be present in the main storage apparatus system 1180, 
and each of the disk units may take the function of the 
25 volume on itself. This is also applied to the sub-disk unit 
1160. 

[0146] Fig. 12 is a block diagram showing a configu- 
ration of a second embodiment of the computer system 
1 000 to which the present invention is applied. 
3 o [0147] A point of difference of the present embodi- 
ment from the first embodiment is that the copy of the 
coherent volume image at the time when the freezing 
instruction has been issued from the host computer 
1010 is generated in the main disk unit 1130 once, and 
35 the data is transferred from the volume thus generated 
to the sub-DKC. 

[0148] The present embodiment is also different from 
the first embodiment in that two volumes are prepared 
for the sub-storage apparatus system, and one of them 
40 is made the volume which is used in order to generate 
the coherent volume. 

[0149] The description will hereinafter be given with 
respect to points of difference from the computer system 
1000 of the first embodiment. The parts which will not 
45 be described here have the same configurations as 
those of the first embodiment, and hence are designated 
with the same reference numerals. 
[0150] A main disk unit 1130' includes a main main- 
volume 1300 and a main sub-volume 1310. 
50 [0151] In the main main-volume 1300, there is stored 
the data which has been transferred from the host com- 
puter 1010. The main sub-volume 1310 is used when 
copying the volume image of the main main-volume 
1300 at a time point when the freezing instruction was 
55 issued. The blocks which the main main-volume 1300 
and the main sub-volume 1 31 0 have, respectively, show 
one-to-one correspondence. 

[0152] The main DKC 1030' has a main bitmap A 
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1340, a main bitmap B 1350, and a main bitmap C 1360 
all of which are contained in the RAM 1260. 
[0153] The main bitmap A 1340, when the contained 
bit is 1 , with respect to the block corresponding to that 
bit, shows that the contents of the data which is stored 
in the main main-volume 1300 are different from those 
of the data which is stored in the main sub-volume 1310. 
[0154] While the main bitmap B 1350 also shows the 
difference between the main main-volume 1 300 and the 
main sub-volume 1 31 0, only the bit corresponding to the 
block in which after the freezing instruction has been 
transmitted from the host computer 1010, the data is 
written to the main main-volume 1300 becomes 1 . 
[0155] The main bitmap C 1360 shows that there is 
the difference in the contents between the main sub-vol- 
ume 1310 and a sub-main-volume 1320. 
[0156] A sub-disk unit 1160' includes the sub-main- 
volume 1320 and a sub-sub-volume 1330. 
[01 57] To the sub-main-volume 1 320, there is written 
the data which has been transferred from the main DKC 
1 030*. In the sub-sub-volume 1 330, there is built the vol- 
ume image of the main main-volume 1300 atatime point 
when the freezing processing was executed last time. 
[0158] A sub-DKC 1040* has a sub-bitmap A 1370 
showing the difference between the sub-main-volume 
1320 and the sub-sub-volume 1330. Then, the sub-bit- 
map A 1370 is contained in the RAM 1260. In the 
present embodiment, the sub-freezing mode 1 090 is not 
used. 

[0159] Figs. 13A to 13D are respectively schematic 
views showing the flow of the data corresponding to the 
present embodiment. 

[0160] In Fig. 13A, there is shown the flow of the data 
in the case where the host computer 1010 does not is- 
sue the freezing instruction. 

[01 61 ] The data which has been transferred from the 
host computer 1 01 0 is written to the main main-volume 
1300 (indicated by an arrow J 190). 
[0162] Then, it is assumed that in the sub-sub-volume 
1330, there is stored the data of the volume image of 
the main main-volume 1300 at a time point when the 
host computer 1 01 0 issued the freezing instruction last 
time. 

[0163] In Fig. 13B, there is shown the flow of the data 
for a time period ranging from a time point when a host 
computer 1010 has issued the freezing instruction up to 
a time point when the main storage apparatus system 
1 1 80 generates, in the main sub-volume 131 0, the copy 
of the volume image of the main main-volume 1300 at 
a time point when the main storage apparatus system 
1180 issued the freezing instruction. 
[0164] The main disk unit 1130 copies the data from 
the main main-volume 1300 to the main sub-volume 
1310 (indicated by an arrow L 210). 
[0165] While the data which the main DKC 1 030' has 
received is written to the main main-volume 1300 (indi- 
cated by an arrow K 200), in the case of writing of the 
data to the block in which the copy to the main sub-vol- 



ume 1310 is not yet carried out, after completion of the 
processing of copying the data indicated by the arrow L 
210, the data is written to the main main-volume 1300. 
[0166] In Fig. 1 3C, there is shown the flow of the data 
5 for a time period ranging from a time point when the vol- 
ume image of the main main-volume 1300 at a point 
when the host computer 1010 issued the freezing in- 
struction has been generated in the main sub-volume 
1310 up to a time point when the volume image gener- 
ic ated in the main sub-volume 1310 is generated in the 
sub-main-volume 1320 which the sub-DKC 1040' man- 
ages. 

[0167] The data which has been transferred from the 
host computer 1 01 0 is written to the main main-volume 
15 1300 (indicated by the arrow M 220). The data of the 
main sub-volume 1310 is read out to the main DKC 
1 030' to be transferred to the sub-DKC 1 040' to be writ- 
ten to the sub-main-volume 1320 (indicated by the arrow 
N 230). 

20 [0168] In Fig. 1 3D, there is shown the flow of the data 
for a time period ranging from a time point when the vol- 
ume image of the main main-volume 1 300 at a time point 
when the host computer 1010 issued the freezing in- 
struction to the sub-main-volume 1 320 has been gener- 

25 ated up to a time point when the volume image thus gen- 
erated is copied to the sub-sub-volume 1330. 
[0169] The data which has been transferred from the 
host computer 1 01 0 is written to the main main-volume 
1300 (indicated by an arrow O 240). 

30 [0170] The sub-DKC 1040' controls the copy of the 
data from the sub-main-volume 1 320 to the sub-sub-vol- 
ume 1330 (indicated by an arrow P 250). 
[01 71 ] In the present embodiment, the copy of the da- 
ta for duplicating the volume image of the main main- 

35 volume 1300 is carried out in such a way that of the data 
which is stored in the source volume and in the destina- 
tion volume, only the differential data is subjected to the 
differential copy. 

[0172] In Figs. 13A, 13B and 13C, the sub-sub-vol- 
40 ume 1330 holds the volume image of the main main- 
volume 1300 at a time point when the host computer 
1010 issued the freezing instruction last time. 
[0173] In Fig. 13D, the sub-main-volume 1320 holds 
the volume image of the main main-volume 1300 at a 
45 time point when the host computer 1010 has issued the 
freezing instruction this time. 

[01 74] Therefore, volume image of the main main-vol- 
ume 1 300 at a time point when the host computer 1010 
issued the freezing instruction will be held in any case. 

50 [0175] Fig. 14 is a schematic view useful in explaining 
the flow of the freezing instruction in the computer sys- 
tem 1000 of the present embodiment. In the figure, the 
vertical direction represents the time base. Thus, it is 
meant that the time elapses as the position on the draw- 

55 ing is located more downwardly. 

[0176] The host computer 1010 issues the freezing in- 
struction to the main DKC 1030'. In response to the 
freezing instruction issued thereto, the main DKC 1030' 
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differential-copies (hereinafter, the differential copy will 
be referred to as "the split", when applicable) all of the 
data, which is stored in the main main-volume 1300 at 
a time point when the freezing instruction was issued, 
to the main sub-volume 1310. After completion of the 
differential copy, the main DKC 1 030' reads out the data 
of the main sub-volume 1310 to transmit the data thus 
read out to the sub-DKC 1040\ Then, the sub-DKC 
1040' writes the data which has been received from the 
main DKC 1030' to the sub-main volume 1320. 
[0177] The main DKC 1030' issues the freezing in- 
struction to the sub-DKC 1040'. After having received 
the freezing instruction, the sub-DKC 1040* splits the 
volume image of the sub-main volume 1320 to the sub- 
sub-volume 1330. After completion of the split, the 
sub-DKC 1 040' transmits the report exhibiting the com- 
pletion of the freezing to the main DKC 1 030'. After hav- 
ing received this report, the main DKC 1 030' informs the 
host computer 1 01 0 of the completion of the freezing. 
[0178] Fig. 15 is a flow chart useful in explaining a 
write processing A 3400 which the main DKC 1030' ex- 
ecutes when the host computer 1010 transmits the data 
to the main storage apparatus system 1180. 
[0179] The main DKC 1030* receives the write data 
from the host computer 1010 (Step 3410) to judge 
whether or not the main freezing mode 1060 is in the 
ON state (Step 3420). 

[01 80] If it is judged in Step 3420 that the main freez- 
ing mode 1060 is in the ON state, then the main DKC 
1030' judges whether or not the bit of the main bitmap 
A 1340 corresponding to the block in which the trans- 
ferred data is stored is 1 (Step 3430). 
[0181] If it is judged in Step 3420 that the bit of the 
main bitmap A 1340 is zero, then the main DKC 1030' 
executes the processing in Step 3470. On the other 
hand, if it is judged in Step 3420 that the bit of the main 
bitmap A 1340 is 1, then the main DKC 1030* controls 
the main disk unit 1130 in such a way as to copy the 
data stored in the block corresponding to the bit of 1 
from the main main volume 1300 to the main sub-vol- 
ume 1310 (Step 3440). 

[0182] After completion of the copy, the main DKC 
1 030' sets to zero the corresponding bit of the main bit- 
map A 1340 (Step 3450) and also sets to 1 the corre- 
sponding bit of the main bitmap C 1360 (Step 3460). 
[0183] The main DKC 1030' sets to 1 the bit of the 
main bitmap B 1350 corresponding to the block in which 
the transferred data is stored (Step 3470) to write the 
write data to the corresponding block of the main main- 
volume 1300 to complete the write processing A 3400 
(Step 3480). 

[0184] On the other hand, if it is judged in Step 3420 
that the main freezing mode is in the OFF state, then 
the main DKC 1 030' sets to 1 the corresponding bit of 
the main bitmap A to execute the processing in Step 
3480 (Step 3490). 

[0185] Fig. 16 is a flow chart useful in explaining the 
main freezing processing A 3600 which the main DKC 



1030' executes when the host computer 1010 has is- 
sued the freezing instruction to the main DKC 1030'. 
[0186] After having received the freezing instruction 
from the host computer 1 01 0 (Step 361 0), the main DKC 
s 1 030' makes the ON state the main freezing mode (Step 
3620) to judge whether or not all of the bits of the main 
bitmap A 11340 is zero (Step 3630). 
[0187] If it is judged in Step 3630 that all of the bits of 
the main bitmap A 1 340 are not zero, then the main DKC 
10 1 030' specifies the block in which the bit is 1 in the main 
bitmap A 1340 (Step 3640). Then, the main DKC 1030' 
reads out the specified block of the main main volume 
1300 to control the main disk 1130* in such a way as to 
copy the block thus read out to the main sub-volume 
*5 1310 (Step 3650). 

[0188] After completion of the copy of the specified 
block, the main DKC 1 030' sets to zero the correspond- 
ing bit of the main bitmap A 1 340 (Step 3660), while sets 
to 1 the corresponding bit of the main bitmap C 1 360 to 
20 return back to the processing in Step 3630 (Step 3670). 
[0189] If it is judged in Step 3630 that all of the bits of 
the main bitmap A 1340 are zero, then the main DKC 
1 030' judges whether or not all of the bits of the bitmap 
C1360 are zero (Step 3680). 
25 [0190] If it is judged in Step 3680 that all of the bits of 
the main bitmap C1360 are not zero, then the main DKC 
1030' selects the bit as 1 of the main bitmap C 1360 
(Step 3690) to read out the block corresponding to the 
bit of the main sub-volume 1310 to transmit the block 
30 thus read out to the sub-DKC 1040* (Step 3700). 

[0191] The main DKC 1030' sets to zero the corre- 
sponding bit of the main bitmap C 1360 to return back 
to the processing in Step 3680 (Step 3710). 
[0192] On the other hand, if it is judged in Step 3680 
35 that all of the bits of the main bitmap C 1360 are zero, 
then the main DKC 1 030' issues the freezing instruction 
to the sub-DKC 1040' (Step 3720) to wait for the report 
exhibiting the freezing completion to be transmitted 
thereto from the sub-DKC 1040' (Step 3730). 
40 [0193] After having received the report exhibiting the 
completion of the freezing from the sub-DKC 1040' 
(Step 3740), the main DKC 1030' copies the contents 
of the main bitmap B 1350 to the main bitmap A 1340 
(Step 3750) to set to zero all of the bits of the main bit- 
45 map B 1350 (Step 3760). The main DKC 1030' makes 
the OFF state the main freezing mode 1 060 (Step 3770) 
to transmit the report exhibiting the freezing completion 
to the host computer 1 01 0 to complete the main freezing 
processing A 3600 (Step 3780). 
50 [0194] Fig. 1 7 is a flow chart useful in explaining the 
sub-remote copy processing A3800 which thesub-DKC 
1 040 executes when the processing of the remote copy 
is executed for the sub-DKC 1040 in Step 3700 of the 
main freezing processing A 3600. 
55 [0195] After having received the data from the main 
DKC 1 030' (Step 381 0), the sub-DKC 1 040 controls the 
sub-disk unit 1 1 60 in such a way that the received data 
is written to the corresponding block of the sub-main- 
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volume 1320 (Step 3820). 
[0196] After the processing of writing the data has 
been completed, the sub-DKC 1 040 sets to 1 the corre- 
sponding bit of the sub-bitmap A 1370 to complete the 
sub-remote copy processing A 3800 (Step 3830). 5 
[0197] Fig. 18 is a flow chart useful in explaining a 
sub-freezing processing A 4000 which the sub-DKC 
1040" executes when the main DKC 1030' has issued 
the freezing instruction to the sub-DKC 1040'. 
[0198] The sub-DKC 1040' which has received the 
freezing instruction from the main DKC 1030' judges 
whether or not all of the bits of the sub-bitmap A 1370 
are zero (Step 4010). 

[01 99] If it is judged in Step 401 0 that all of the bits of 
the sub-bitmap A 1370 are not zero, then the sub-DKC 
1 040' controls the sub-disk unit 1 1 60' in such a way that 
it selects the block of the sub-main-volume 1320 corre- 
sponding to the bit as 1 of the sub-bitmap A 1370 (Step 
4020) to read out the block thus selected to copy the 
block thus read out to the corresponding block of the 
sub-sub-volume 1330 (Step 4030). 
[0200] After completion of the copy of the correspond- 
ing block, the sub-DKC 1040' sets to zero the corre- 
sponding bit of the sub-bitmap A 1 370 to return back to 
the processing in Step 4010 (Step 4040). 
[0201] On the other hand, if it is judged in Step 4010 
that all of the bits of the sub-bitmap A 1370 are zero, 
then the sub-DKC 1040* transmits the report exhibiting 
the completion of the freezing to the main DKC 1 030' to 
complete the sub-freezing processing A 4000 (Step 
4050). 

[0202] In the present embodiment, since the data of 
the volume image of the main main-volume 1300 at a 
time point when the host computer 1010 issued the 
freezing instruction last time is stored in either the sub- 
sub-volume 1330 or the sub-main-volume 1320, the 
processing corresponding to the sub-recovery process- 
ing 3000 become unnecessary. 

[0203] When the read request has been made from 
the host computer 1 01 0, the processing(s) as in the first 
embodiment does(do) not need to be executed, and the 
data of the main main-volume 1 300 has only to be trans- 
ferred. 

[0204] Fig. 1 9 is a block diagram showing a configu- 
ration of a third embodiment of the computer system 
1000 to which the present invention is applied. 
[0205] In the present embodiment, a point that the re- 
mote copy is carried out only in Fig. 1 3C of Figs. 1 3A to 
13D and hence the network can not be used effectively 
in the second embodiment is improved. 
[0206] The description will hereinafter be given with 
respect to only a point of difference from the second em- 
bodiment. 

[0207] A main DKC 1 030" has a main bitmap D 1 380 
which the RAM 1260 includes. 

[0208] The main bitmap D 1 380 shows the data which 
is not yet copied to the main sub-volume 1310 and which 
is stored in the main main-volume 1300, i.e., the block 
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containing that data which was remote-copied to the 
sub-main-volume 1320 before issue of the freezing in- 
struction. 

[0209] A sub-DKC 1 040" has a sub-bitmap B 1 390. 
[021 0] The sub-bitmap B 1 390 shows the block which 
is remote-copied from a main DKC 1030" to the sub- 
main volume 1320 on and after the freezing instruction 
has been issued this time but before the freezing instruc- 
tion will be issued next time. 

[0211] In the present embodiment, the main freezing 
mode takes the integral number from 0 to 3. The sub- 
freezing mode shows either ON or OFF. 
[0212] Figs. 20A to 20D are respectively schematic 
views showing the flow of the data in the computer sys- 
tem 1000 of the present embodiment. 
[0213] The description will hereinafter be given with 
respect to the present embodiment while comparing the 
present embodiment with Figs. 1 3A to 1 3D showing the 
flow of the data in the computer system 1000 to which 
the second embodiment is applied. 
[0214] In Fig. 20A, the data which has been written 
from the host computer 1010 to the main main-volume 
1300 is transferred to the sub-DKC 1040" before the 
host computer 1010 issues the freezing instruction (in- 
dicated by an arrow R 270). An arrow Q 260 corre- 
sponds to the arrow J 190 shown in Fig. 13A. 
[0215] An arrow S 280 and an arrow T 290 in Fig. 20B 
show the flow of the data corresponding to the arrow K 
200 and the arrow L 210 in Fig. 13B, respectively. 
[0216] The data which has already been copied (indi- 
cated by the arrow T 290) to the main sub-volume 1 31 0 
but which is not yet sent to the sub-main-volume 1320 
is transferred from the corresponding block of the main 
sub-volume 1310 to the sub-DKC 1 040" through the 
main DKC 1030" to be written to the sub-main-volume 
1320 (indicated by an arrow K 300). 
[021 7] An arrow V 31 0 and an arrow W 320 shown in 
Fig. 20C correspond to the arrow M 220 and the arrow 
N 230 shown in Fig. 13C, respectively. 
[0218] An arrow X 330 and an arrow Z 350 shown in 
Fig. 20D correspond to the arrow O and the arrow P 
shown in Fig. 13, respectively. 

[0219] The data which has been newly written to the 
main main-volume 1 300 (indicated by the arrow X 330) 
is copied to the sub-main-volume 1320 (indicated by an 
arrow Y 340) before the host computer 1010 issues the 
next freezing instruction. 

[0220] In the case where the data for the block which 
is not yet copied from the sub-main-volume 1 320 to the 
sub-sub-volume 1300 has been received from the main 
DKC 1 030" by the sub-DKC 1 040", the sub-DKC 1 040" 
copies the data in the block corresponding to the data 
which has been received once from the sub-main-vol- 
ume 1 320 to the sub-sub-volume 1 330 (indicated by the 
arrow Z 350). Thereafter, the sub-DKC 1040" controls 
the sub-disk unit 1160' in such a way that the data is 
written to the corresponding block of the sub-main-vol- 
ume 1320. 
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[0221] Fig. 21 is a schematic view useful in explaining 
the flow of the freezing instruction in the computer sys- 
tem 1000 to which the present embodiment is applied. 
In the figure, the vertical direction represents the time 
base, and hence the time elapses as the position on the 
drawing is located more downwardly. 
[0222] Comparing Fig. 21 with Fig. 14, it is understood 
that a point of difference is that the remote copy is car- 
ried out for a longer time period. 
[0223] Fig. 22 is a flow chart useful in explaining a 
write processing B 4200 which the main DKC 1 030" ex- 
ecutes when the data has been transferred from the host 
computer 1010 to the main storage apparatus system 
1180. 

[0224] The main DKC 1030" receives the write data 
from the host computer 1010 (Step 4210) to judge 
whether or not the main freezing mode 1060 is zero 
(Step 4220). If it is judged in Step 4220 that the main 
freezing mode 1060 is not zero, then the main DKC 
1030" judges whether or not the main freezing mode 
1060 is 1 (Step 4230). 

[0225] If it is judged in Step 4230 that the main freez- 
ing mode 1 060 is not 1 , then the main DKC 1 030" judges 
whether or not the main freezing mode 1 060 is 2 (Step 
4240). 

[0226] If it is judged in Step 4240 that the main freez- 
ing mode 1 060 is 2, then the main DKC 1 030" executes 
the processing in Step 4260. On the other hand, if it is 
judged in Step 4240 that the freezing mode 1 060 is not 
2 (i.e., it is judged to be 3), then the main DKC 1030" 
sets to zero the bit of the main bitmap D 1380 corre- 
sponding to the transferred block (Step 4250). 
[0227] The main DKC 1030" sets to 1 the bit corre- 
sponding to the write data of the main bitmap A 1340 
(Step 4260) and controls the main disk unit 1 130" in such 
a way that the write data is stored in the corresponding 
block of the main main-volume 1300 to complete the 
main write processing B 4200 (Step 4270). 
[0228] On the other hand, if it is judged in Step 4220 
that the main freezing mode 1 060 is zero, then the main 
DKC 1030" sets to zero the corresponding bit of the 
main bitmap C 1380 to execute the processing in Step 
4250 (Step 4280). 

[0229] In addition, if it is judged in Step 4230 that the 
mam freezing mode 1060 is 1, then the main DKC 
1 030" judges whether or not the corresponding bit of the 
main bitmap A 1340 is 1 (Step 4290). If it is judged in 
Step 4290 that the corresponding bit is zero, then the 
main DKC 1 030*' executes the processing in Step 4330. 
On the other hand, if it is judged in Step 4290 that the 
corresponding bit is 1, then the main DKC 
1030" controls the main disk unit 1160' in such a way 
that the data of the block of the main main-volume 1 300 
corresponding to the bit of interest is copied to the cor- 
responding block of the main sub-volume 1310 (Steo 
4300). K 
[0230] The main DKC 1 030" sets to zero the bit of the 
main bitmap A 1340 corresponding to the copied data 



(Step 4310). The main DKC 1030" sets to 1 the bit of 
the main bitmap C 1 360 corresponding to the copied da- 
ta (Step 4320). In addition, the main DKC 1030" sets to 
1 the bit of the main bitmap B 1 350 corresponding to the 
5 copied data (Step 4330) to return back to the processing 
in Step 4270. 

[0231] Fig. 23 is a flow chart useful in explaining a 
main freezing processing B 4400 which the main DKC 
1030" executes when the host computer 1010 has is- 
10 sued the freezing instruction to the main DKC 1 030". 
[0232] After having received the freezing instruction 
from the host computer 1010 (Step 441 0), the main DKC 
1030" sets to 1 the main freezing mode 1060 to com- 
plete the main freezing processing B 4400 (Step 4420). 
'5 [0233] Fig. 24 is a flow chart useful in explaining a 
main copy processing 4600 which is activated by the 
main DKC 1 030" at the time when turning ON the power 
source of the main storage apparatus system 1180, and 
thereafter the main DKC 1030" continues to execute as 
20 one task. 

[0234] The main DKC 1030" judges whether or not 
the main freezing mode 1060 is 1 (Step 4610). If it is 
judged in Step 4610 that the main freezing mode 1060 
is 1, then the main DKC 1030" judges whether or not 
25 the bit of 1 is present in the bits contained in the main 
bitmap A 1340 (Step 4620). 

[0235] If it is judged in Step 4610 that the bit of 1 is 
present in the bits contained in the main bitmap A 1 340, 
then the main DKC 1030" controls the main disk unit 
30 1 1 30" in such a way that the block corresponding to the 
bit of interest is selected (Step 4630), and the data of 
the block corresponding to the bit of the main main vol- 
ume 1300 thus selected is copied to the corresponding 
block of the main sub-volume 1310 (Step 4640). 
35 [0236] After completion of the copy, the main DKC 
1 030" sets to zero the corresponding bit of the main bit- 
map A 1 340 (Step 4650), while sets to 1 the correspond- 
ing bit of the main bitmap C 1360 to return back to the 
processing in Step 4620 (Step 4660). 
40 [0237] On the other hand, if it is judged in Step 461 0 
that the main freezing mode is not 1 , then the main DKC 
1 030" executes the processing in Step 4680. 
[0238] In addition, if it is judged in Step 4620 that the 
bit of 1 is absent in the main bitmap A 1340, then the 
45 main DKC 1 030" sets to 2 the main freezing mode 1 060 
(Step 4670), and carries out waiting for some time to 
return back to the processing in Step 461 0 (Step 4680). 
[0239] Fig. 25 is a flow chart useful in explaining a 
main remote copy processing 4800 which is activated 
50 by the main DKC 1 030" at the time when turning ON the 
power source of the main source apparatus system and 
which the main DKC 1030" executes as one task. 
[0240] The main DKC 1 030" judges whetherthe main 
freezing mode 1060 is zero or 3 (Step 4810). If it is 
55 judged in Step 481 0 that the main freezing mode 1 060 
is zero or 3, then the main DKC 1030" judges whether 
or not the block in which the bit of the main bitmap A 
1340 is 1 is present (Step 4820). If so, the main DKC 
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1 030" selects the block of interest (Step 4830). 
[0241] The main DKC 1030" sets to 1 the bit of the 
main bitmap D 1 380 corresponding to the selected block 
(Step 4840) to read out the corresponding block from 
the main main-volume 1300 to transmit the block thus 
read out to the sub-DKC 1040" (Step 4850). 
[0242] The main DKC 1 030" receives the report ex- 
hibiting the reception of the data from the sub-DKC 
1040" to return back to the processing in Step 4810 
(Step 4860). 

[0243] On the other hand, if it is judged in Step 4820 
that the block in which the bit of the main bitmap A 1 340 
is 1 is absent, then the main DKC 1 030" carries out step 
of waiting for some time (for about several milliseconds) 
to return back to the processing in Step 4810 (Step 
4870). 

[0244] In addition, if it is judged in Step 481 0 that the 
main freezing mode 1 060 is neither zero nor 3, then the 
main DKC 1030" judges whether or not the block is 
present in which the main bitmap C 1360 is 1 and also 
the main bitmap D 1380 is zero (Step 4880). 
[0245] If it is judged in Step 4880 that the block fulfill- 
ing the above-mentioned conditions is present, then the 
main DKC 1 030" selects the block of interest (Step 
4890) to set to zero the corresponding bit of the main 
bitmap C 1 360 (Step 4900). The main DKC 1 030" reads 
out the block thus selected from the main sub-volume 
1310 to transfer the block thus read out to the sub-DKC 
1040" (Step 4910). 

[0246] The main DKC 1 030" receives the report ex- 
hibiting the reception of the data from the sub-DKC 
1040" to return back to the processing in Step 4810 
(Step 4920). 

[0247] On the other hand, if it is judged in Step 4880 
that the block is not present in which the main bitmap C 
1 360 is 1 and also the main bitmap D 1 380 is zero, then 
the main DKC 1030" judges whether or not the main 
freezing mode 1060 is 2 (Step 4930). 
[0248] If it is judged in Step 4930 that the main freez- 
ing mode 1 060 is 2, then the main DKC 1 030" clears all 
of the bits in the main bitmap D 1 380 to zero (Step 4940), 
and sets to 3 the main freezing mode 1 060 (Step 4950) 
and then issues the freezing instruction to the sub-DKC 
1040" to return back to the processing in Step 4810 
(Step 4960). 

[0249] On the other hand, if it is judged in Step 4930 
that the main freezing mode 1 060 is not 2, then the main 
DKC 1 030" carried out the step of waiting for some time 
(for about several milliseconds) to return back to the 
processing in Step 4810 (Step 4970). 
[0250] Fig. 26 is a flow chart useful in explaining a 
main freezing completion processing 5000 which the 
main DKC 1030" executes at the time when having re- 
ceived the report exhibiting the completion of the freez- 
ing from the sub-DKC 1040". 

[0251] After having received the report exhibiting the 
freezing completion from the sub-DKC 1040" (Step 
501 0), the main DKC 1 030" sets to zero the main freez- 



ing mode 1060 (Step 5020) and informs the host com- 
puter 1010 of the freezing completion to complete the 
main freezing completion processing 5000 (Step 5030). 
[0252] Fig. 27 is a flow chart useful in explaining a 

5 sub-freezing processing 5200 which the sub-DKC 1 040" 
executes at the time when the main DKC 1 030" has is- 
sued the freezing instruction to the sub-DKC 1040". 
[0253] After having received the freezing instruction 
from the main DKC 1030" (Step 5210), the sub-DKC 

10 1 040" makes the ON state the sub-freezing mode 1 090 
(Step 5220) to judge whether or not the bit of 1 is present 
in the sub-bitmap A 1 370 (Step 5230). 
[0254] If it is judged in Step 5230 that the bit of 1 is 
present in the sub-bitmap A 1370, then the sub-DKC 

is 1 040" controls the sub-disk unit 1 1 60' in such a way that 
the block corresponding to the bit of interest is selected 
(Step 5240), and the block thus selected of the sub- 
main-volume 1 320 is read out to be copied to the corre- 
sponding block of the sub-sub-volume 1330 (Step 

20 5250). 

[0255] The sub-DKC 1040" sets to zero the corre- 
sponding bit of the sub-bitmap A 1 370 to return back to 
processing in Step 5230 (Step 5260). 
[0256] On the other hand, if it is judged in Step 5230 

25 that the bit of 1 is absent in the sub-bitmap A 1 370, then 
the sub-DKC 1 040" copies the sub-bitmap B 1 390 to the 
sub-bitmap A 1 370 (Step 5270) to make all of the bits 
of the sub-bitmap B 1 390 to zero (Step 5280). 
[0257] The sub-DKC 1 040" makes the OFF state the 

30 sub-freezing mode 1090 (Step 5290) and informs the 
main DKC 1 040" of the freezing completion to complete 
the sub-freezing processing 5200 (Step 5300). 
[0258] Fig. 28 is a flow chart useful in explaining a 
sub-remote copy processing B 5400 which the sub-DKC 

35 1040" executes at the time when in Step 4910 in the 
main remote copy processing B 4800, the main DKC 
1 030" remote-copies the data to the sub-DKC 1 040". 
[0259] After having received the data from the main 
DKC 1 030" (Step 541 0), the sub-DKC 1 040" informs the 

40 main DKC 1030" of the reception of the data (Step 
5420). 

[0260] Thereafter, the sub-DKC 1 040" judges wheth- 
er or not the sub-freezing mode 1090 is in the ON state 
(Step 5430). If it is judged in Step 5430 that the sub- 

45 freezing mode 1090 is in the ON state, then the 
sub-DKC 1040" judges whether or not that the bit of 1 
is present in the sub-bitmap A 1370 (Step 5440). If it is 
judged in Step 5440 that the bit of 1 is absent in the sub- 
bitmap A 1370, then the sub-DKC 1040" executes the 

50 processing in Step 5470. 

[0261] On the other hand, if it is judged in Step 5440 
that the bit of 1 is present in the sub-bitmap A 1 370, then 
the sub-DKC 1040" controls the sub-disk unit 1160" in 
such a way that the block of the sub-main-volume 1 320 

55 corresponding to the bit of 1 is read out to be copied to 
the corresponding block of the sub-sub-volume 1330 
(Step 5450). 

[0262] The sub-DKC 1 040" sets to zero the corre- 
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sponding bit of the sub-bitmap A 1370 (Step 5460), 
while sets to 1 the corresponding bit of the sub-bitmap 
B 1390 (Step 5470). The sub-DKC 1040" controls the 
sub-disk unit 11 60' in such a way that the received data 
is written to the sub-main volume 1 320 to complete the s 
sub-remote copy processing B 5400 (Step 5480). 
[0263J On the other hand, if it is judged in Step 5430 
that the sub-freezing mode 1090 is in the OFF state, 
then the sub-DKC 1040" makes 1 the corresponding bit 
of the sub-bitmap A 1370 to execute the processing in 10 
Step 5480 (Step 5490). 

[0264] In the present embodiment, since the volume 
image of the main main-volume 1300 at a time point 
when the host computer 1010 issued the freezing in- 
struction last time is held in the form of the data stored is 
in the sub-sub-volume 1330 or in the form of the com- 
bination of the data which is stored in the sub-sub-vol- 
ume 1330 and the sub-main-volume 1320, the process- 
ing corresponding to the sub-recovery processing 3000 
becomes unnecessary. 20 
[0265] When the request to read the data has been 
made from the host computer 1 01 0, the data of the main 
main-volume 1300 may be transferred thereto. 
[0266] Next, a fourth embodiment of the present in- 
vention will hereinafter be described. 25 
[0267] A point of difference of the fourth embodiment 
from other embodiments is that the data which is trans- 
ferred from the main storage apparatus system 1130 to 
the sub-storage apparatus system 1160 is encrypted. 
[0268] The fourth embodiment will now be described 30 
on the basis of the second embodiment. But, it goes 
without saying that in the first embodiment and the third 
embodiment as well, the present embodiment can be 
adopted. 

[0269] In the present embodiment, when the data is 35 
transferred from the main main-volume 1 300 to the main 
sub-volume 1 31 0, the data to be transferred is encrypt- 
ed (encoded). 

[0270] In addition, the encrypted data is transferred 
from the main sub-volume 1 31 0 to the sub-main-volume 40 
1320, and when the encrypted data is copied from the 
sub-main-volume 1 320 to the sub-sub-volume 1 330, the 
data of interest is decoded. 

[0271] As a result, the encrypted data will be trans- 
ferred on the network 1 050. The description will herein- *> 
below be given with respect to a point of difference from 
the second embodiment. 

[0272] In the present embodiment, in Fig. 13B,theda- 
ta is copied from the main main-volume 1 300 to the main 
sub-volume 1310 while the data is encrypted (encoded) so 
(indicated by an arrow L 21 0). 

[0273] In addition, in Fig. 13D, in the sub-DKC 1040', 
the data is copied from the sub-main-volume 1320 to 
the sub-sub-volume 1330 while the encrypted data is 
decoded (indicated by an arrow P 250). 55 
[0274] In Fig. 14, the stored data is encrypted when 
the main DKC 1030' is split. In addition, when the 2 
sub-DKC 1 040' is split, the stored data which is already 



encrypted is decoded. 

[0275] In Step 3440 shown in Fig. 15, the main DKC 
1030' copies the data stored in the corresponding block 
from the main main-volume 1300 to the main sub-vol- 
ume 1310 after the encryption of the data of interest. 
[0276] In Step 3650 shown in Fig. 16, the main DKC 
1030' controls the main disk unit 1130' in such a way 
that the corresponding block of the main main-volume 
1 300 is read out to be encrypted, and the encrypted data 
is copied to the main sub-volume 1310. 
[0277] In Step 4030 shown in Fig. 18, the sub-DKC 
1 040' controls the sub-disk unit 1 1 60' in such a way that 
the corresponding block of the sub-main-volume 1320 
is read out to the sub-DKC 1 040' and the encrypted data 
is decoded to be copied to the corresponding block of 
the sub-sub-volume 1330. 

[0278] By adopting the configuration of the present 
embodiment, the volume image in the freezing can be 
ensured in any one of the disk units while ensuring the 
safety of the data which is being transferred. 
[0279] By adopting the configuration of the present in- 
vention, even when the remote copy of no guarantee to 
order is carried out, the volume image having excellent 
coherency can be ensured. 

[0280] While the present invention has been particu- 
larly shown and described with reference to the pre- 
ferred embodiments, it will be understood that the vari- 
ous changes and modifications will occur to those skilled 
in the art without departing from the scope and true spirit 
of the invention. The scope of the invention is therefor 
to be determined solely by the appended claims. 

Claims 

1 . For use in an information processing system (1 000) 
including a host computer (1010), a main storage 
apparatus system (1180), and a sub-storage appa- 
ratus system (11 90) which is electrically connected 
to said main storage apparatus system, a method 
of carrying out back-up of the data from said main 
storage apparatus system to said sub-storage ap- 
paratus system, comprising the steps of: 

sending an instruction to maintain the state of 
the data in said main storage apparatus system 
from said host computer to said main storage 
apparatus system; 

maintaining the state of the data in said main 
storage apparatus system at a time point when 
said instruction has been issued; and 
structuring the data, which said main storage 
system has at a time point when said instruction 
has been issued, on said sub-storage appara- 
tus system on the basis of the maintained data. 

The method of claim 1 , wherein said step of struc- 
turing the data further comprises the steps of: 
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transferring the maintained data in said main 
storage apparatus system to said sub-storage 
apparatus system; 

after completion of the transfer of the main- 
tained data, transferring a signal exhibiting the 
completion of the transfer from said main stor- 
age apparatus system to said sub-storage ap- 
paratus system; and 

with the reception of the signal exhibiting the 
completion of the transfer as a turning point, 
structuring the data on said sub-storage appa- 
ratus system. 

3. The method of claim 2, further comprising the step 
of: 

keeping the storage of the data in a first storage 
area of said main storage apparatus system un- 
til said host computer has issued the instruc- 
tion, 

wherein said step of maintaining the state of 
the data is, after said host computer has issued the 
instruction, to copy the data stored in said first stor- 
age area at a time point of the issue of the instruc- 
tion to a second storage area of said main storage 
apparatus system, and 

wherein said step of transferring the data is to 
transfer the data which has been copied to said sec- 
ond storage area to said sub-storage apparatus 
system. 

4. The method of claim 3, wherein said step of struc- 
turing the data is to store the maintained data which 
has been transferred in a third storage area of said 
sub-storage apparatus system to structure the 
maintained data in a fourth storage area of said 
substorage apparatus system using the data held 
in said third storage area. 

5. The method of claim 2, wherein said step of trans- 
ferring the data is to transfer the difference between 
the data which was stored in said main storage ap- 
paratus system before the issue of the instruction 
from said host computer and the maintained data 
at a time point when said host computer has issued 
the instruction. 

6. The method of claim 5, wherein said step of main- 
taining the data further comprises the steps of: 

storing the data in said first storage area of said 
main storage apparatus system; 
if when updating the data which is stored in said 
first storage area on and after said host com- 
puter has issued the instruction, the difference 
has already been sent to said sub-storage ap- 
paratus system on the basis of said step of 



sending the difference, storing the data in said 
first storage area; and 

if the difference is not yet sent to said sub-stor- 
age apparatus system, storing the information 
5 of the data to be updated in said second storage 

area of said main storage apparatus system. 

7. The method of claim 6, wherein said step of struc- 
turing the data further comprises the steps of: 

w 

holding the difference, which has been sent 
from said main storage apparatus system, in 
said third storage area of said sub-storage ap- 
paratus system; and 
*5 on the basis of the difference held in said third 

storage area, structuring the maintained data 
in said fourth storage area of said sub-storage 
apparatus system. 

20 8. The method of claim 2, wherein said transfer step 
further comprises the steps of: 

transferring the data, which is stored in said first 
storage area and which is to be updated, to said 

25 sub-storage apparatus system until said host 

computer has issued the instruction; and 
after said host computer has issued the instruc- 
tion, transferring the data stored in said second 
storage area to said sub-storage apparatus 

30 system. 

9. A storage apparatus system, comprising: 

a main storage apparatus system (1180) which 
35 has a first storage area, a second storage area 

and a main disk controller (1 030, 1 030', 1 030") 
and which is electrically connected to a host 
computer (1 01 0); and 

a sub-storage apparatus system (1190) which 
40 has a third storage area, a fourth storage area 

and a sub-disk controller (1040, 1040', 1040") 
and which is electrically connected to said main 
storage apparatus system, 

45 wherein said main disk controller has: 

means for recording the data, which has been 
sent from said host computer, in said first stor- 
age area until said host computer has issued 

so an instruction for freezing; 

means for in response to the freezing instruc- 
tion issued from said host computer, copying 
the data which has been recorded in said first 
storage area to said second storage area; and 

55 means for sending the copied data to said sub- 

storage apparatus system, and 

wherein said sub-disk controller has: 
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means for receiving the data sent thereto to 
hold the data thus received in said third storage 
area; and 

means for structuring the data, which is held in 
said first storage area at a time point when said 5 
host computer has issued the freezing instruc- 
tion, in said fourth storage area using the data 
held in said third storage area. 

10. A storage apparatus system, comprising: w 

a main storage apparatus system (1 1 80) which 
has a first storage area, a second storage area 
and a main disk controller (1 030, 1 030', 1 030") 
and which is electrically connected to a host 15 
computer (1010); and 

a sub-storage apparatus system (1190) which 
has a third storage area, a fourth storage area 
and a sub-disk controller (1040, 1040*, 1040") 
and which is electrically connected to said main 20 
storage apparatus system, 

wherein said main disk controller has: means 
for recording therein the data, which has been sent 
from said host computer, in said first storage area 25 
until said host computer has issued an instruction 
for freezing; 

means for sending a difference between the da- 
ta which is stored in said first storage area at a 30 
predetermined time point and the data which is 
recorded to said sub-storage apparatus sys- 
tem; 

means for in response to the freezing instruc- 
tion issued from said host computer, with re- 35 
spect to writing of the data to said first storage 
area by said host computer, when the differ- 
ence between the data each becoming an ob- 
ject has already been sent to said sub-storage 
apparatus system, writing the data to said first 40 
storage area; and 

means for when the difference between the da- 
ta each becoming an object is not yet sent to 
said sub-storage apparatus system, writing the 
data to said second storage area, and 45 

wherein said disk controller has: 

means for receiving the difference sent thereto 
to hold the difference thus received in said third so 
storage area; and 

means for structuring the data, which is held in 
said first storage area at a time point when said 
host computer has issued the freezing instruc- 
tion, in said fourth storage area using the differ- 55 
ence held in said third storage area. 

. A storage apparatus system, comprising: 



a main storage apparatus system (11 80) which 
has a first storage area, a second storage area 
and a main disk controller (1 030, 1 030', 1 030") 
and which is electrically connected to a host 
computer (1010); and 

a sub-storage apparatus system (1190) which 
has a third storage area, a fourth storage area 
and a sub-disk controller (1040, 1040', 1040") 
and which is electrically connected to said main 
storage apparatus system, 

wherein said main disk controller has: 

means for recording therein the data, which has 
been sent from said host computer, in said first 
storage area until said host computer has is- 
sued an instruction for freezing; 
means for sending the data stored in said first 
storage area to said sub-storage apparatus 
system; 

means for in response to the freezing instruc- 
tion issued from said host computer, copying 
the data stored in said first storage area to said 
second storage area; and 
means for sending the copied data to said sub- 
storage apparatus system, and 

wherein said sub-disk controller has: 

means for receiving both of the data which has 
been sent to be stored in said first storage area 
and the copied data to hold both of the data in 
said third storage area; and 
means for structuring the data, which is held in 
said first storage area at a time point when said 
host computer has issued the freezing instruc- 
tion, in said fourth storage area using the data 
stored in said third storage area. 

1 2. The system of claim 1 1 , wherein said main disk con- 
troller has means for sending a signal showing, that 
the data has been sent, to said sub-storage appa- 
ratus system, and 

wherein said sub-disk controller has means 
for after having received the signal showing that the 
data has been sent, structuring the data which is 
held in said first storage area in said fourth storage 
area. 

13. The system of claim 12, wherein said main diskcon- 
troller has means for when sending the data to said 
sub-storage apparatus system, encrypting the data 
of interest, and 

wherein said sub-disk controller has means 
for decoding the encrypted data which has been re- 
ceived from said main storage apparatus system. 

14. The invention of claim 4, 7 or 13, wherein the data 
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which was stored in said first storage area at a pre- 
determined time point before the issue of the in- 
struction from said host computer is stored in said 
fourth storage area. 
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